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ABSTRACT 

Many  structured  large-scale  linear  programming  problems  can 
be  transformed  into  an  equivalent  problem  of  maximizing  a  piecewise 
linear,  concave  function  subject  to  linear  constraints.  The  equivalent 
problem  can,  in  turn,  be  solved  in  a  finite  number  of  steps  using  a 
steepest  ascent  algorithm.  This  principle  is  applied  to  block  diagonal 
systems  yielding  refinements  of  existing  algorithms.  An  application 
to  the  multi-stage  problem  yields  an  entirely  new  algorithm. 


INTRODUCTION 


There  are  two  distinct  approaches  for  the  solution  of  large-scale 
linear  programs.  The  direct  or  compact  basis  technique  uses  special 
pivoting  and  storage  rules  to  maintain  an  easily  handled  form  of  the 
basis.  We  shall  consider  the  indirect  approach.  The  key  element  in 
this  method  is  the  definition  and  solution  of  an  equivalent  concave  pro¬ 
gramming  problem.  This  equivalent  problem  is  generally  much  smaller 
than  the  original  problem.  In  many  papers  it  is  not  mentioned  explicitly. 

This  paper  is  related  to  and  motivated  by  the  work  of  Geoffrion  [ll] 
and  Lasdon  [16].  They  discuss  two  methods,  which  Geoffrion  has  aptly 
termed  price  and  resource  directive,  of  defining  equivalent  problems 
for  nonlinear,  organizational  problems.  In  addition,  several  possible 
solution  techniques  are  described.  Both  authors  propose  the  use  of 
large  step  gradient  or  feasible  direction  algorithms.  Our  attention 
will  be  focused  on  this  type  of  algorithm  when  the  original  problem  is 
linear.  While  we  are  restricting  our  attention  to  linear  programs,  we 
do  consider  a  wider  class  of  problem.  Thus  multi-stage  as  well  as 
block  diagonal  (organizational)  problems  are  considered.  In  principle 
the  theory  is  applicable  to  any  large  scale  linear  program  that  can 
be  transformed  into  an  equivalent  problem  of  maximizing  a  piece- 
wise  linear,  concave  function.  In  this  case  we  give  a  general  method 
for  constructing  an  algorithm.  Also,  by  restricting  our  attention  to 
linear  problems,  we  are  able  to  obtain  sharper  results,  such  as  finite 
convergence. 


i 
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We  shall  demonstrate  that  the  equivalent  problem  can  itself  be 
transformed  into  a  second  linear  program.  This  new  linear  program 
is  then  solved  in  a  finite  number  of  steps  using  the  Primal-Dual  (PD) 
algorithm  of  Dantzig,  Ford  and  Fulkerson,  [8].  If  a  Feasible  Direction 
(FD)  algorithm,  [22],  is  designed  for  the  concave  program  it  yields  a 
procedure  identical"^  to  the  PD  algorithm.  This  extends  the  equivalence 
from  the  linear  case:  [22],  page  100.  Three  examples  are  explored  and 
the  algorithm  is  applied  to  the  equivalent  concave  program  in  each  in¬ 
stance.  The  three  are:  block  diagonal  problems,  using  the  price  direc¬ 
tive  approach,  block  diagonal  problems,  with  the  resource  directive 
approach,  and  multi-stage  or  lower  block  trianglular  problems.  In 
each  instance  we  obtain  a  finite  algorithm  for  solving  these  problems. 

Section  I  quickly  reviews  basic  facts  of  linear  programming  and 
linear  inequalities,  while  introducing  necessary  terminology.  In  sec¬ 
tion  II  we  examine  the  fundamental  problem,  maximizing  a  piecewise 
linear,  concave  function  subject  to  linear  inequalities.  The  Primal- 
Dual  (PD)  and  Feasible  Direction  (FD)  algorithms  are  outlined  and 
compared.  The  remaining  three  sections  describe  applications  of  the 
general  principle. 

The  examples  given  in  sections  III-V  are  complementary.  The 
first  presents  an  application  of  the  method  in  a  familiar  setting,  i.  e. 
the  price  directive  approach  to  the  block  diagonal  problem.  This  paves 
the  way  for  a  description  of  the  resource  directive  method  for  the  same, 
block  diagonal  problem.  This  application,  in  turn,  employs  many  of  the 
techniques  needed  in  the  multi-stage  example. 


^The  two  differ  only  in  the  selection  of  step  size. 
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In  the  first  two  applications  we  obtain  refinements  of  existing 
algorithms.  The  method  and  results  in  the  multi-stage  case  are 
entirely  new.  This  problem  originally  motivated  the  study. 

A  few  items  have  been  intentionally  ommitted.  There  is  no 
attempt  to  show  direct  applicability  of  the  theory  for  each  example. 

It  is  a  straight  forward  exercise  to  transform  any  of  the  equivalent 
problems  into  the  form  of  (11:1).  In  all  the  examples  described,  the 
question  of  finding  a  first  feasible  solution  is  ommitted.  Information 
on  this  can  be  found  in,  [2],  [6]  and  [23],  No  detailed  comparison 

with  other  algorithms  has  been  made.  There  is  no  speculation  on  ' 

the  relative  efficiency  of  the  procedures,  and  no  consideration  of 
the  implementation  problems.  The  purpose  of  the  paper  is  to  demon¬ 
strate  a  unified  manner  in  which  algorithms  can  be  constructed  and  to 
show  the  results  in  three  familiar  cases. 

An  effort  has  been  made  to  minimize  notation.  Superscripts 
are  used  to  differentiate  among  vectors  and  matrices,  while  sub¬ 
scripts  indicate  elements  of  a  particular  vector  or  matrix.  When  no 
confusion  is  possible  the  notation  p1  e  P  will  indicate  that  p1  is  a 
column  of  the  matrix  P.  The  vector  e,  prehaps  superscripted,  will 
indicate  a  vector  of  ones  of  appropriate  length.  Thus  if  K  is  an  n 
n 

vector  e\  =  and  if  p  is  a  scalar  p(e)  =  (p,  p, . . .  ,  p).  The  norm 

i=l  * 
of  a  vector  is  the  absolute  value  of  the  sum  of  its  coordinates:  thus 

n 

|]f ||  =  ^|  f.J  .  Finally,  the  operator  Min,  when  applied  to  a  vector 
i=l 
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takes  on  the  value  of  the  smallest  coordinate.  Therefore  Min  [uP] 
is  equal  to  the  minimum  of  the  scalars  up1,  for  p1  e  P. 


I.  BACKGROUND 


The  facts  and  definitions  used  in  the  paper  are  summarized 

here. 

First  consider  the  convex  polyhedral  set  X 


X  =  { x |  Ax  =  b,  x  ^  O) 


(1) 


A  vector  p  is  an  extreme  point  of  X  if  p  cannot  be  expressed  as  a 
proper  convex  combination  of  two  distinct  points  in  X.  Vector  r  is 
an  extreme  ray  of  X  if  r  is  an  extreme  point  of  the  set  Y. 

Y  s  (y|  Ay  -  0,  ey  si,  y  5  0)  (2) 


Let  the  extreme  points  and  rays  be  the  columns  of  P  and  R , 
resp. .  We  rely  heavily  on  the  important  representation  theorem  of 
Goldman. 

Th:  (Goldman)  [13] 

x  e  X  if  and  only  if  x  =  P\  +  Ry,  where  el  =  1,  1  =  0,  y  -  0 


(3) 


Now  consider  the  linear  programming  problem: 

Min  (c  -  u)x 
Subject  to  x  e  X 

Using  (3),  we  can  deduce  the  following  about  problem  (4): 
(i)  The  problem  is  feasible  iff  X  has  an  extreme  point. 


(4) 


(ii)  For  any  x  e  X 

(c  -  u)x  =  (c  -  u)PX  +  (c  -  u)RX  :  eX  =  1,  X  5  0,  y  -  0 

(iii)  Problem  (4)  has  a  finite  optimal  solution  iff  X  is  nonvoid  and 
(c  -  u)R  a  0. 

(iv)  If  (4)  has  a  finite  optimal  solution  it  has  an  extreme  point 
optimal  solution. 

Now  we  will  assume  A  has  full  row  rank,  and  that  (4)  has  been 
solved  by  the  simplex  method  yielding  a  finite  optimal  solution.  The 
final  simplex  tableau  yields  a  new  representation  of  X. 

X  =  { (w,  y,  z)  |  Iw  +  Fy  +  Dz  =  b,  w  5  0,  y  £  0,  z  5  0) 

(w,y,  z)  reflects  a  partitioning  of  the  columns  of  A  into  three  sets, 
and  (I,  F,D,b)  are  the  coefficients  found  in  the  final  simplex  tableau. 

The  reduced  cost  coefficients  for  the  three  vectors  are  (0,0,  d),  where 
d  >  0.  If  6  is  the  optimal  value  of  (4)  then  the  value  of  any  solution 
x  =  (w,  y,  z)  is  given  by 

(c  -  u)x  =  Ow  +  Oy  +  dz  +6 

From  this  it  is  easy  to  see  that: 

Prop:  (5) 

x  =  (w,  y,  z)  is  optimal  if  and  only  if  Iw  +  Fy  =  b,  w  5  0,  y  5  0  and  z  =  0 

Therefore  the  set  of  optimal  solutions,  X,  is  also  a  convex  polyhedral 
set  and  its  defining  relations  may  be  obtained  directly  from  the  final 
simplex  tableau  ^ 


j-  Of  course  this  data  can  be  obtained  using  the  revised  simplex  method. 
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X  =  [x|  Ax  =  b,  x  =  O) 
where  A  =  (I,  F) ,  x  =  (w,  y). 

X  can  also  be  defined  in  terms  of  the  extreme  points  and  rays 
of  X.  Let  P  be  the  matrix  of  optimal  extreme  point  solutions  and  R 
the  matrix  of  extreme  tight  rays.  If  p  is  a  column  of  Pfthen  (c  -  u)p  =  6; 
if  r  is  a  column  of  then  (c  -  u)r  =  0 

Prop:  (6) 

x  e  X  if  and  only  if  x  =  PX  +  STy  where  eX  =  1,  X  5  0,  y  -  0 
Proof: 

For  any  feasible  x. 

(c  -  u)x  =  (c  -  u)PX  +  (c  -  u)Ry  ;  where  eX  =  1,  X  5  0,  y  5  0 

Since  the  optimal  value  is  6  we  must  have 

(c  -  u)p*  S  6  for  each  p*  e  P 
(c  -  u)r*  5  0  for  each  e  R 


Thus  it  is  easy  to  see  that 


(c  -  u)x  =  6  if  and  only  if 
(c  -  u)pl  >  6  implies  X.  =  0 
(c  -  u)r^  >  0  implies  y.  =  0 


This  establishes  (6).  || 

Some  information  about  P  and  R  can  be  derived  from  the  final 
tableau.  (w,y)  =  (b,  0)  is  obviously  an  extreme  optimal  solution. 
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If  some  column,  say  f,  of  F  is  nonpositive;  then 

(w,yi.y2 . )  =  (-f\l,0,....)/(l  +  Ilf1!!) 

is  a  tight  extreme  ray.  We  will  call  these  the  at  hand,  extreme 
optimal  solutions  and  tight  rays. 

A  typical  problem  we  shall  have  is:  given  a  vector  v,  and 
scalar  p:  Does  (p,v)  satisfy; 


p(e)  +  vP  5  0 

vKM 


(7) 


This  question  can  be  answered  by  considering  the  linear  program 


Min  -  vx 

s.  t.  Ax  =  b,  x?  0 


(8) 


This  type  of  problem  will  be  refered  to  as  a  tight  program,  since 
we  are  looking  among  solutions  that  are  optimal  for  another  objective 
function.  The  tight  problem  has  several  important  properties  that  we 
shall  use  in  sections  I12-V, 

Prop:  (9) 

(i)  (P,  v)  solves  (7)  iff  the  optimal  value  of  the  tight  program  is  ^  p. 

(ii)  If  (p,v)  does  not  solve  (7),  then  the  tight  program  will  generate 
and  p£P,  or  r  e  R ,  such  that 

p  +  vp  >  0 
or 

vr  >  0 
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Proof: 

The  tight  problem  is  assumed  to  be  feasible,  so  only  three 
things  can  occur. 

Case  1.  The  tight  problem  is  unbounded  below.  In  this  case  the 
simplex  method  will  generate  an  extreme  ray  such  that 
-vr  <  0. 

Case  2.  The  tight  problem  has  an  optimal  extreme  point  solution 
p,  but  -vp  <  p. 

Case  3.  The  tight  problem  has  an  optimal  extreme  point  solution 
p,  and  -vp  £  p. 

Since  p  is  optimal  we  must  have  -vp1  5  p,  for  each  column 
p*  of  P,  and  -vr^  5  0,  for  each  r^  e  R.  || 


II.  THE  PD  AND  FD  ALGORITHMS 


In  this  section  we  shall  show  how  the  PD  and  FD  algorithms 
can  be  applied  to  solve  a  simple  concave  programming  problem.  It 
will  be  clear  that  the  two  approaches  are  nearly  identical. 

The  simple  problem  is: 


Maximize  h(u) 

(1) 

Subject  to  u  e  U  =  fu|  uD  -  g} 

The  objective,  h(u),  is  the  optimal  value  of  a  linear  program. 
h(u)  =  Min  (c  -  u)x 


Subject  to  x  e  X  =  [x|  Ax  =  b,  x  5  o] 


(2) 
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We  shall  say,  h(u)  =  -  ®  if  X  is  void,  and  4  *  if  (2)  is  unbounded. 

If  either  U  or  X  is  void  then  (1)  is  infeasible.  These  cases  are 
readily  detected,  so  we  will  assume  U  and  X  are  not  empty. 

As  noted  in  I,  we  can  write  x  as 

x  =  PX  4  Ry  ;  eX  =  1,  X  *  0,  y  ^  0 

where  P  is  the  matrix  of  extreme  points,  and  R  the  matrix  of 
extreme  rays.  Suppose  for  some  r\  that  (c  -  u)r^  <  0;  then  (2) 
has  no  lower  bound,  and  h(u)  =  -  ®.  Since  we  are  trying  to  maximize 
h(u)  this  situation  should  be  avoided.  This  is  accomplished  by  adding 
the  constraints  (c  -  u)R  =  0  to  the  original  problem.  Under  those 
restrictions 

h(u)  =  Min[(c  -  u)P] 

In  other  words,  (2)  has  an  extreme  point  optimal  solution.  Thus 
instead  of  (1)  we  could  look  at  the  equivalent  problem 

Maximize  Min  [(c  -  u)P] 

Subject  to  uD  =  g 
uR  -  cR 

Problem  (3)  can  be  simplified  further  by  introducing  the  scalar 
objective  p  and  requiring  p  -  (c  -  u)pl  for  all  pl  e  P.  Thus 


(3) 


(1)  can  be  expressed  as  a  linear  program. 
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Maximize  p 

Subject  to  p(e)  +  uP  -  cP 
uR^cR 
uD  -  g 

o 

Unfortunately,  we  don't  know  P  and  R  and  it  is  computationally 
impractical  to  find  them.  The  PD  algorithm  can  work  in  this  enviro 
ment  since  it  is  only  concerned  with  the  active,  or  tight  constraints. 
We  shall  assume  the  reader  is  familiar  with  the  PD  algorithm  and 
briefly  indicate  its  application  to  (4).  Complete  descriptions  and 
proofs  of  finite  convergence  can  be  found  in:  [6],  [8],  [20], 

Assume  we  have  established  that  U  and  X  are  nonempty,  our 
current  solution  (6,u)  satisfies  the  constaints  of  (4),  and  6  =  h(u). 
Let  P  be  the  matrix  of  p1  satisfying 

6  =  h(u)  =  (c  -  ujp1  ; 

R  the  matrix  of  r^  satisfying 

0  =  (c  -  u)rJ  ; 

— 

and  finally  D  the  matrix  of  d  satisfying 

,k 

gk  =  ud  . 

P,  R,  and  D  represent  the  optimal  extreme  points,  tight  extreme 
rays  and  tight  constraints. 

To  obtain  a  new  dual  solution  we  solve  the  restricted  problem. 


(4) 


Maximize  p 


(5) 


Subject  to  p(e)  +  vP  ^  0 
vRS  0 
vD  S  0 

(-1,  -1,.,-1)5V5(1,1,.,1) 


The  restricted  problem  always  has  an  optimal  solution  (p,  v)  with 
p  =  0.  If  p  =  0,  then  (6,u)  is  the  optimal  solution  to  problem  (4); 
other  wise  we  compute  the  following  numbers: 


X1 


=  Minimum 
f  j|  vr^  >  0) 


(c  -  u)r 


vrJ 


j 


i 


X 


2 


=  Minimum 
{ kj  vd^  >  0} 


X  3  =  Minimum  I  (c  ~  U)P  ^ 


{i|  p  +  vp*  >  0)[  P  +  vp 


X  =Min[X1,X2,X3]  >0 


ia  is  infinite:  (4)  is  unbounded,  otherwise  the  new  solution  is 
(6,u)  +X(p,v).  There  is  a  strict  improvement  at  each  iteration  and 
the  optimal  solution  is  attained  in  a  finite  number  of  iterations. 

Now  we  shall  describe  the  application  of  a  FD  algorithm  to  (1). 

The  objective,  h(u),  is  concave  and  piecewise  linear,  but  not  differenti¬ 
able.  We  will  show  below,  however,  that  it  does  have  finite  directional 
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derivatives  in  all  the  interesting  directions.  The  directional 
derivative  of  h(u)  in  the  direction  v  is  defined  as: 

Vh(u:v)  =  limit  M"  +  '  h(U> 

a_0+ 

Suppose  we  have  a  u  e  U  and  h(u)  is  finite.  A  direction  v  is 

k 

feasible  if  (u  +  av)  e  U  for  some  a  >  0.  This  implies  that  vd  5  0, 
for  each  k  such  that  ud  =  g^.  We  will  look  for  the  feasible  direc¬ 
tion  that  maximizes  the  rate  of  increase  in  h.  That  is 

Maximize  7h(u:v) 

Subject  to  vD  5  0 

(-1,  -1,..,-1)3  VS  (1.1,..,  1) 

The  last  constraint  bounds  the  direction,  since  Vh(u:v)  is  homo- 

U  M  |q 

geneous  in  v,  D  is  the  matrix  of  tight  constraints:  d  e  D  iff  ud  =  g^. 

Suppose  (c  -  u)r^  =  0,  and  vr^  >  O.then  for  every  a>  0 
(c  -  u  -  av)r^  <  0,  so  h(u  +  av)  =  -  ®  and  Vh(u:v)  =  -  ®.  Since  we 
are  trying  to  maximize  Vh(u:v)  we  won't  consider  moving  in  direc¬ 
tions  which  give  an  infinite  decrease.  If  we  define  R  as  before,  we 
can  write  the  direction  finding  problem  as; 

Maximize  qrh(u:v) 

Subject  to  vD  =  0 
vR  ^  0 


(-1,  -1 . -l)-£v^  (1,1,..,  1) 
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To  show  the  direction  finding  problem  is  equivalent  to  the 
restricted  problem,  we  will  use  a  theorem  of  Danskin,  [5].  A 
proof  is  included  since  it  is  slightly  different  from  the  original. 

First,  let's  define  P  as  the  matrix  whose  columns,  p,  satisfy 

<c  -  u)p  =  h(u) 

Th:  [5] ,  page  22 

If  vR  5  0,  then 

Vh(u:v)  =  Min[-vP] 

Proof: 

Since  vR  =  0,  there  exists  a>  0  such  that  for  a  e  [0,a] 

(c  -  u  -  av)R  =  0 

and 

h(u  +  av)  =  Min[(c  -  u  -  av)P] 

For  any  pl  e  P,(c  -  u  -  av)pl  =  h(u  +  av)  for  a  =  0,  and  (c  -  u)p*  =  h(u) 
Thus 

i  _  (c  -  u  -  av)p*  -  (c  -  u)p*  >  h(u  +  av)  -  h(u) 
p  “a  a 

as  a-*  0+  we  get 
For  any  p1  e  P, 

-vp‘  1  lim  BUP  HW  +  OV)  -  h(u) 

a— *0+ 

Min[-vP]  ^  lim  sup  ™  ■" 

+  a 

a— *0 


(7) 


Thus 


-14- 


Now  suppose  some  sequence  ctn  satisfies 

h(u  4  anv)  -  h(u)  . 
an 

i 

For  each  n,  there  exists  a  p  n  e  P  such  that 

i 

h(u  +  anv)  =  (c  -  u  -  anv)p  n 

Since  P  has  a  finite  number  of  columns,  one  must  occur  infinitely 

i* 

often.  Denote  this  column  as  p  and  the  subsequence  on  which  it 
occurs  as  a  . 

For  each  m  and  any  p  e  P 

h(u  +  amv)  =  (c  -  u  -  amv)pi  s  (c  -  u  -  amv)p 

In  the  limit  we  have: 

h(u)  =  (c  -  u)p*  5  Min[(c  -  u)P] 

i*  — 

This  implies  that  p  e  P:  so 

3  =  -vp*  ■=  Min[-vP] 


Thus 


lim  inf  h<u  +  ^v)  -  h<u>  5  Minf-vP] 

a— *o+ 


which  proves  the  theorem 
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Using  (7),  we  can  write  the  direction  finding  problem  as: 

Maximize  [Min[-vP]) 

Subject  to  vR  =  0 
vD  5  0 

(-1.  -1....-1)  s  v*  (1,1... ,D 

Define  a  new  variable  p,  requiring  that  P  -  -vp1  for  p1  e  P  ,  and 
transform  the  direction  finding  problem  into  a  linear  program. 

Maximize  p  (8) 

Subject  to  p  (e)  +  vP  -  0 
vR  S  0 
vD  -  0 

(-1.  -l....-l)2  (1,1,.. ,1) 

This  demonstrates  the  equivalence  of  the  direction  finding 
and  the  restricted  problems. 

A 8  before,  (8)  will  have  an  optimal  solution  (p,  v)  with  p  5  0. 

If  p  =0,  then  the  current  solution,  u,  is  optimal  for  for  (1).  Other¬ 
wise  we  can  make  a  strict  improvement  by  changing  u  in  the  direction 
v.  The  next  step  in  the  FD  algorithm  is  to  move  in  the  direction  v  and 
maximize  the  objective,  h(u  +otv),  while  maintaining  feasibility: 

(u  +  av)  e  U  . 
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To  this  end  we  define: 

X2  s  Max  (X|  (u  +  Xv)  e  U} 

g(X)  ■  h(u  +  Xv) 

g(X4)  =  Max  { g(X)  |  X  *  0} 

X  =  Min  {X2,  X4]  >  o 

If  X  is  infinite  then  (1)  is  unbounded,  otherwise  we  define 

(6,  u)  =  (6,  u)  +  X  (p,  v)  as  our  new  solution. 

2 

It  is  easy  to  see  that  the  X  defined  in  (9)  is  the  same  as  (6). 

4  1  1 

Also,  note  that  X  -  X  ;  since  for  X  <  X,  g(X)  is  equal  to  -  ®.  If 

we  graph  g(X)  we  see  it  is  piecewise  linear  and  concave.  It  increases 

strictly  until  X  =  X  ,  as  defined  by  (6).  At  this  point  the  rate  of 

increase  is  reduced  but  the  function  may  continue  to  increase.  Thus 

X3  S  X4  and  in  some  case,  see  below,  X3  <  X4, 

Therefore  the  two  algorithms  are  not  precisely  equivalent.  In 

some  instances  they  will  choose  different  new  solutions.  The  FD 

algorithm  will  always  find  a  solution  with  a  higher  value.  On  the  other 

hand,  the  PD  algorithm  converges  in  a  finite  number  of  steps,  while 

the  convergence  properties  of  this  FD  algorithm  are  uncertain.  Also, 

3 

the  PD  algorithm  examines  more  options.  After  stopping  at  X  ,  the 
algorithm  is  still  free  to  go  to  X  .  Thus  the  step  lengths  of  the  PD 
algorithm  seem  to  be  theoretically  superior.  In  terms  of  the  FD 
algorithm,  taking  suboptimal  steps  can  be  interpreted  as  an  anti- 
zigzagging  procedure. 
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III.  EXAMPLE:  BLOCK  DIAGONAL  LINEAR  PROGRAMS -THE 
PRICE  DIRECTIVE  APPROACH 


Our  first  example  will  be  an  application  to  the  block  diagonal 
linear  program: 


Minimize 


JLi 

t=l 


*  t  t 
c  x 


(1) 


T 

Subject  to  B^x*  =  d 
t=l 

aV  *^,^0  t  *  1,2,..  ,T 

This  problem  is  familiar  to  all  those  who  have  studied 
Dantzig  and  Wolfe  Decomposition,  [10].  Other  methods  have  been 
proposed  by,  Balas  [2],  Bell  [3],  and  Abadie  and  Williams  [l].  All 
of  these  methods  are  price  directive,  that  is  they  are  designed  to 
solve  the  concave  programming  problem  (3).  We  will  apply  the 
algorithm  outlined  in  section  II  to  problem  (3).  The  resulting  algo¬ 
rithm  is  a  slight  generalization  of  Balas's.  The  generalization 
allows  us  to  handle  the  case  of  unbounded  subproblems  in  a  direct 
manner.  In  addition,  we  have  described  a  convenient  method  for 
solving  the  restricted  problem. 

In  what  follows  we  will  describe  how  the  algorithm  applies  to 
this  particular  problem.  Imbedded  in  this  discussion  is  the  outline 
of  a  separate  algorithm  for  solving  the  restricted  problem,  using  the 
Dantzig  and  Wolfe  technique. 
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The  subproblems  are 

Minimize  (c*  -  uB*)x*  (2) 

Subject  to  A*x*  =  b*,  x*i  0 

Define  h*(u)  as  the  optimal  value  (2).  If  (2)  la  infeasible 
h*(u)  =  +  •;  and  h*(u)  =  -  •  if  (2)  is  unbounded.  We  will  assume  that 
each  subproblem  is  feasible,  if  not,  then  the  original  problem,  (1), 
is  infeasible.  It  is  well  known  that  solving  the  dual  of  (1)  is  equivalent 
to  solving 

T 

Maximize  ^Th*(u)  (30 

t«l 


Subject  to  u  unrestricted 


Suppose  we  have  found  a  u  such  that  each  subproblem  has  a 
finite  optimal  solution.  Let  and  K*  denote  the  matrices  of 
optimal  extreme  points  and  tight  extreme  rays  for  each  subproblem. 
Thus 


and 


(c*  -  uB1)  P*  ■  h'fuHe*) 


(c*  -  ubSR*  •  0 


If  we  are  considering  changing  u  in  the  direction  v,  we  must  insure 
that  -  vB^*  *  0  for  each  t:  otherwise  any  slight  change  will  make  one 
of  the  subproblems  unbounded.  Using  Theorem  11:7,  we  can  see  that 


Vh*(u:v)  *  Min(-vB*P*) 
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The  restricted  problem  is 

T 

Maximise  ^Min  [-vB*P*J 
t*l 

Subject  to  vB^R*  S  0,  t*l,  2....T 
(•1«  •*  ..»•!)*  v  *  (l(  1 . 1) 

This  is  equivalent  to 

Maximise  p*  ♦  p*  ♦ .  ♦  p*^  (4) 

Subject  to  p*(*S  4  vBV  *  0 

vB*R*  so  t  •  1,*,..  ,T 

(-1.-I....-H  *  v  1  (1.1... .« 

Finally,  the  dual  of  (4)  is 

Minimise  e(n  eij  (S) 

T 

Subject  to  ♦  HVl  ♦  1”  •  l’  •  0 

t*l 

•  1  t  •  1,1.  .  .  ,T 

t  0,  «  0,  "  t  0,  -  «  0 

Problem  (I)  can  be  solved  bv  the  Osntsig  and  Wolfe  method,  to 
avoid  the  task  of  enumerating  sll  the  columns  of  P*  sod  R*.  We  will 
describe  one  major  cycle  of  the  algorithm 
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At  the  start  of  each  major  cycle  a  basic  feasible  solution  of  (5) 
will  be  available,  and  selection  of  the  new  price  u,  will  generate  new 
extreme  points  and  extreme  rays  from  at  least  one  subproblem. 

For  each  subproblem  we  have  available  a  matrix  representation 
of  the  optimal  solutions. 

«t  f-t.  Tt-t  rt  -t  *  Tt  _t.  -t  .  t  t  ' 

X  =[x|Ax  =b,  x  5  OJ  ,  A  =  (I,  F  ),  x  =  (w  ,y  ) 

In  this  particular  procedure  we  are  going  to  be  solving  an  incom- 
plete  inversion  of  (S).  Thus  all  of  the  optimal  extreme  points  and 
extreme  rays  are  not  known,  just  the  few  we  have  left  from  former 
restricted  problems  and  the  new  ones  we  find  at  hand.  We  will  call 
the  problem  the  partial  or  cut  down  version  of  (5).  Thus  we  have  a  cut 
down  version  of  the  restricted  problem,  which  ignores  some  of  the 
columns. 

12  T 

Suppose  we  have  solved  a  cut  down  version  of  (5)  and  (p  ,p . p  ,  v) 

1  2  T 

are  the  optimal  multipliers.  If  (P  ,p . p  ,  v)  is  feasible  for  (4),  then 

it  is  optimal.  Feasibility  can  be  tested  by  solving  the  tight  subproblems  (6). 

Min  (6) 

Subject  to  X***  ■  E*,  -  0 

If,  for  every  t,  the  optimal  value  of  (6)  is  no  less  then  p*,  then 
I  2  T 

(P  ,  P  ,v)  is  feasible  for  (4j,  and  thus  optimal.  In  any  other 

case  the  tight  subproblems  will  generate  new  columns  for  (S).  This 
procedure  continues  until  (M  has  been  solved,  yielding  a  set  of  optimal 
multiplers  p  . P^.r).  The  columns  of  (5)  for  which 
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or 


p*  +  vBtp  =  0 
vBtr  =  0 


can  be  retained.  These  extreme  points  and  extreme  rays  will  be 

I 

optimal  and  tight  for  the  next  price  u  ,  Thus  for  the  next  cycle  we  will 
at  least  retain  a  basic  feasible  solution  of  (5).  The  other  extreme  points 
and  rays  in  (5)  can  be  deleted  .  They  will  not  be  optimal  or  tight  in  the 

I 

subproblems  (2)  for  the  new  price  u  . 

To  find  the  new  price  we  consider  the  parametric  objectives 
(c*  -  uB*  -  aB*)  x*  in  the  subproblems  (2).  a  is  increased  until  some  new 
activity  has  a  zero  reduced  cost  coefficient.  Let  a*  be  the  value  of  a  at 
which  this  occurs. 

Then  let: 

a*  *  Min  [a4J  t  =  1, 2, . . , T]  (7) 

If  a*  is  infinite,  then  (3)  is  unbounded:  otherwise  let 

*  _ 

u'  =  u  +  a  v 

♦  a 

and  for  every  t  such  that  a  =  a  ,  determine  the  new  optimal  solution  or 
tight  ray  and  introduce  them  into  (5).  This  completes  a  major  cycle. 

The  algorithm  is  summarized  below,  but  first  a  few  passing 
comments. 

If  T  is  very  large  we  might  want  to  use  a  compact  basis  technique 
in  solving  (5).  The  generalized  upper  bounding  approach,  (9 J, of  Dantzig 
and  Van  Slyke  can  be  employed. 

Finally,  as  an  alternative  approach  we  note  that  problem  (5)  is 
equivalent  to  (8)  which  can,  in  turn,  be  solved  using  Rosen's  technique 
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Minimize  e(n  +  a)  (8) 

T 

Subject  to 

t=l 

Iw*  +  Ftyt  =  b1  t  *  1,2,..  ,T 
w*  5  o,  y*  ?  0,  n  5  0,  o  5  0 

B  it  the  restriction  of  B*  to  those  Activities  that  can  be  positive  in  an 
optimal  basis. 

BLOCK  DIAGONAL -PR ICE  DIRECTIVE 

Step  0:  Obtain  a  u  such  that  each  subproblem,(2),  has  a  finite  optimal 

solution.  If  no  such  u  exist,  then  the  dual  of  (1)  is  Infeasible. 

If  any  subproblem  is  infeasible,  then  (1)  is  infeasible. 

Step  It  Problem  (5)  is  solved  using  the  Dantzig  and  Wolfe  Decomposition 
technique.  Columns  are  generated  from  the  tight  subproblems 
(6).  u  is  optimal  if  the  /alue  of  (5)  is  0. 

Step  2;  Given  the  optimal  multipliers  of  (5),  analyze  the  subproblems. 

(2), parametrically  to  determine  a  new  u.  If  a*  in  (7)  is  infinite, 
then  (I)  is  infeasible:  otherwise  generate  the  new  columns  and 
send  them  to  (5).  Go  to  stup  I, 


IV.  EXAMPLE:  BLOCK  DIAGONAL  LINEAR  PROGRAMS-THE 
RESOURCE  DIRECTIVE  APPROACH 

This  example  outlines  another  method  for  solving  (1). 

T 

Minimise  I*'*'  '» 

t*l 

T 

Subject  to  B*x*  ■  d 
t»l 

Atxt  •  b*  .  x*  f  0  t  *  1.2....T 

As  before  we  shall  apply  our  method  to  an  equivalent,  this  time 
convex,  programming  problem  (14).  The  fundamental  idea  is  partition* 
ing  the  vector  d  among  the  subproblems,  and  letting  the  sectors  compete 
for  scarce  resources.  This  approach  was  originally  considered  by 
Benders  [4),and  Kornai  and  Liptak  (IS).  It  has  recently  been  discussed 
in  much  greater  generality  by  Geoffrion  (ll),ar>d  Silverman  (19).  For 
complete  background  and  motivation  see  (ll). 

When  the  algorithm  of  section  II  is  applied  to  (4)  we  obtain  an 
algorithm  similar  to  Zschau's  (2S);  but  a  great  dial  easier  to  implement. 
Actually,  it  is  closer  to  Geoffrion  (ll),  although  we  get  some  simpiificii* 
tion  and  finite  convergence  by  considering  the  all  linear  case. 

The  tnbproblems  are: 

Minimise  c*u*  (2) 

Subject  to  B*x*  ■  y* 
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T 

These  are  obtained  by  partitioning  the  vector  d,  ’  y*  =  d.  We  will 

t=l 

find  it  more  convenient  to  work  with  the  dual  of  (2). 

Maximize  u^y*  +  v*b* 

Subject  to  u*A*  +  v*B*  -  c* 


(3) 


These  are  the  problems  we  propose  to  solve,  but  we'll  resist 
the  temptation  to  transform  them  into  "standard  form".  Define  h*(y*) 
as  the  optimal  value  of  (3).  As  usual,  h*(y*)  is  +•  if  (3)  is  unbounded 
and  -  •  if  (3)  is  infeasible.  Note  that  if  any  subproblem, ( 3), is  infeasible, 
then  the  dual  of  (I)  is  also  infeasible.  The  convex  programming  problem 
equivalent  to  (I)  is: 


Minimize 


2ht(yt> 


t«i 


Subject  to 


«  d 


H) 


Before  describing  the  restricted  problem,  we  will  look  at  (3) 
in  greater  detail,  omitting  superscripts.  Assume  for  some  y.  h(y) 
is  finite,  and  let  ((T,  V)  d  enote  the  matrix  of  optimal  extreme  solutions. 
Thus  each  row  (u,v)  of  (U,  V)  is  an  extreme  point  satisfying: 


uy  ♦  vb  «  h(y) 
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Similarly,  let  (R,0)  be  the  matrix  of  tight  extreme  raya.  If  an  extreme 
ray  (r,q)  is  a  row  of  (R,<3)  then 

ry  +  qb  =  0 

We  are  interested  in  changing  y  in  some  direction  z.  Unless 
Rz  5  0,  we  will  have  h(y  +  dz)  =  +  ®,  for  any  positive  a.  In  addition, 
we  can  show  that 


Vh(y:z)  a  Max  (Uz) 

if  Re  5  o. 

As  before,  the  final  simplex  tableau  will  contain  a  matrix  representa¬ 
tion  of  the  set  of  optimal  solution.  Rather  than  describing  these  equations 
we  will  denote  the  set  as  W*. 

The  reader  can  easily  establish  that  (5)  is  the  correct  form  for  the 
restricted  problem. 

T 

Minimize  2°*  <*> 

t«i 

Subject  to  P*(eS  -  U*z*  5  o 

-  RV  *  0 


and 


(-1.-1 


•  • 


-U  '  *  ■  (1.1. 

T 

P‘° 


I)  for  t  a  1,2...  ,T 
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We  propose  to  solve  (5)  using  the  dual  simplex  method  with 

upper  bounded  variables,  [21].  As  before,  after  the  subproblems 

have  been  solved  certain  new  columns  from  U*  and  K*  will  be 

available.  These  are  added  as  constraints  to  (5),  which  is  solved 

by  doing  dual  simplex  steps.  Thus  we  have  solved  a  version  of  (5) 

in  which  some  of  the  constraints  have  been  ignored.  Suppose 
t  t  T 

(p  ,z  ]  j  is  optimal  for  this  cut  down  version  of  (5).  We  can  show 
that  (p  ,  z *]  j  is  optimal  for  (5),  with  all  constraints  considered,  by 
checking  to  see  if  {p  ,  z is  feasible  for  (5).  This  is  accomplished 
by  solving  the  tight  subproblems: 

Maximize  u*z*  (6) 


Subject  to  (u*,  v*)  €  W1 

a  a  »r 

The  current  solution  fp  ,  z1]^  will  he  feasible  for  (5)  if  the  optimal 
value  of  each  tight  subproblem  is  no  greater  than  p*.  Otherwise  the 
tight  subproblem  will  generate  a  u*  or  r*  such  that; 


or 


t 

u  z 


<  0 


t 

r  z 


<r  0 


These  rows  arc  added  to  (5)  and  we  do  dual  simplex  steps  until  a  new 

optimum  is  attained.  This  procedure  is  repeated  until  an  optimal 

T 

t  t  T  '  a| 

solution  of  (S),  (p  ,t  is  available.  If  \  p  c  0,  then  the  current 

t7l 
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partition  solves  (4):  otherwise  we  can  make  a  strict  improvement 
by  changing  the  current  partition  in  the  direction  of  f*  • 

For  each  subproblem  (3),  consider  the  parametric  objective 
function  u*(y*  ♦  as*)  *  v*b*.  Increase  a  until  some  new  column  is 
able  to  enter  the  basis  or  an  unbounded  solution  is  detected.  Call 
the  value  of  a  for  which  this  occurs  a*.  Let 

a  ■  Min[a*|  t  *  1, 2, . .  ,T) 

If  a  is  infinite  then  we  have  an  unbounded  solution  of  (4).  Other* 
wise,  the  new  partition  is 

(yV  ■  y*  ♦<****  . 

For  each  t,  such  that  a*  ■  a  ,  we  send  the  new  extreme  points  and 
rays  to  (5).  where  they  will  be  infeasible  under  the  old  solution 
fp  ,  s  .  In  addition,  all  the  rows  of  (5)  that  were  slack  under 
the  old  optimal  solution  can  be  dropped,  while  the  tight  rows  are 
retained. 

The  principle  is  exactly  the  same  as  the  one  employed  in  the 
price  directive  case,  but  we  have  seen  fit  to  solve  the  restricted 
problem  rr’her  than  its  dual.  The  solution  of  the  restricted  problem 
involves  the  use  of  a  Dantclg  and  Wolfe  scheme  for  row  generation. 
At  any  iteration  in  the  solution  of  ($).  the  cut  down  or  partial  version 
of  ($),  is  solved  using  the  dual  simplex  method  with  upper -bounded 
variables. 


(7) 
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BLOCK  DIAGONAL-RESOURCE  DIRECTIVE  APPROACH 

Step  0:  Find  a  partition  of  d  such  that  each  aubproblem,  ( J),  hat  a 
finite  optimal  aolution.  If  no  such  partition  MiiU,  then  (I) 
ia  infeaaible.  If  any  aubproblem  ia  infeasible,  then  the  dual 
of  (I)  ia  infeaaible.  Send  the  optimal  extreme  aolutiona  and 
tight  raya,  at  hand,  to  the  reatricted  problem. 

Step  1:  Solve  the  partial  veraion  of  (5)  by  the  dual  a  implex  method 
with  upper  bounded  variablea,  and  generate  new  rows  by 
aolving  the  tight  aubproblema,(fc).  If  the  optimal  value  ef  (i) 
ia  aeretthen  the  current  aolution  ia  optimal. 

Step  2:  Analyte  the  aubprobtema,(  )),  parametrically  to  determine  the 
new  partition.  If  o  ,  (71,  la  infinite,  then  (I)  ha  a  an  unbounded 
aolution:  otherwtae  generate  the  new  rows  for  ft)  and  ge  to 
atep  1. 
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Like  the  block  diagonal  problem,  which  ia  a  special  case,  this 
problem  has  been  studied  extensively.  A  host  of  special  techniques 
are  described  in,  [17]  and  two  compact  basis  methods  are  outlined 
in  [14],  and  [18].  The  problem  can  be  hammered  into  block  diagonal 
form,  but  this  is  awkward.  A  recent  report,  [12],  by  Glassey  discus¬ 
ses  some  of  these  points  and  proposes  an  interesting  price-resource 
communication  technique  which  solves  a  special  case  of  (2). 

First,  we  will  make  an  assumption  about  (l),  in  order  to  trans¬ 
form  it  into  a  more  manageble  form,  (2).  Then  we'll  describe  (2)  in 
terms  of  an  equivalent  convex  programming  problem.  This  equivalent 
problem  is  solved  using  the  algorithm  of  section  II. 

Although  the  methods  we  are  describing  apply  to  (1),  we  will 
make  an  assumption  which  allows  us  to  discuss  a  special  case.  The 
general  case  is  described  briefly  in  an  appendix. 

Our  assumption  is: 

HtS  =  H8  for  all  s  and  t  =  s  +  1,  s  +  2, . .  ,  T 

Using  this  assumption  and  subtracting  rows  we  can  transform  (1)  into 
an  equivalent  problem: 

T 

Minimize  ^  c4x4  (2) 

t=l 

Subject  to  A*x*  =  b4  +  K4  *x4-4 

x4?0  t  =  1, 2, . .  ,  T 

Here,  Kl  =  H4  +  A*  for  t  =  1,. .  ,T-1:  and  K°  =  0.  Also,  b4  =  d4  -  d4"1 
for  t  =  2,  3, .  .  ,  T;  and  b*  =  d*  . 
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The  dual  of  (2)  is 


Maximize 


T 

2  wtfet 

t=l 


Subject  to  w*A*  =•  c*  +  wt+*K*  t  =  1,  2, . .  ,  T 


(3) 


If  (2)  is  considered  as  a  sequential  problem,  then  the  right 
t  t-1  t “1  X 

hand  side,  {b  +  K  x  },  describes  a  trajectory.  Our  pro¬ 
cedure  is  called  trajectory  optimization  since  we  are  going  to  fix 
the  trajectory  and  then  find  the  best  solution  that  follows  it.  This 
computation  yields  information  useful  in  finding  a  better  trajectory  or 
indicates  that  the  present  trajectory  is  optimal.  As  with  price  and 
resource  directive  approaches,  selection  of  a  trajectory  allows  us 

to  decompose  the  problem  into  easily  solvable  subproblems. 

1  2  T  »1 

For  our  purpose  the  vector  z  =  (z  ,  z  ,...,*)  defines  a  tra- 
jectory  fb  +  K  ’s’1)  ^  •  The  subproblems  optimize  along  this 

path. 


Minimize  c*x* 


C  V  4.  *  *  t  t  ,t  „t-l  t-1 

Subject  to  Ax  =  b  +K  z 


„t  t  t  t 
K  x  =  K  z 


x*  ^  0 


(4) 


0  T 

where  K  =  K  =0 

The  subproblems  we  will  actually  solve  are  the  duals  of  (4). 
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Maximize  u*(b*  +  K*  ^z*~*)  +  v^K^z*  (5) 

Subject  to  u*A*  +  v*K*  -  c* 

The  optimal  value  of  (5)  is  given  by  the  function  h*(z).  As 
usual,  h*(z)  is  +  •  if  (5)  is  unbounded  and  -  00  if  (5)  has  no  feasible 
solution. 

The  equivalent  convex  programming  problem  is 

T 

Minimize  /  h*(z)  (6) 

4m 

t=l 

Subject  to  z  i  0 

The  equivalence  is  almost  tautalogical.  It  is  based  on  two 

facts.  If  fx*}^  i»  any  feasible  solution  of  (2)  then  deter- 

t  T 

mines  a  trajectory  along  which  {x  is  feasible.  Also,  if  for 

some  z,  fx  aolves  the  subproblems  (4),  then  {x1}  traces 

t  T 

out  the  same  trajectory  as  z  and  fx  }t=1  is  a  feasible  solut:  n  of  (2). 
Theorem:  (7) 

(i)  If  [x*}^  solves  (2),  then  fx*}^’1  solves  (6). 

t  T  »1 

(ii)  If  f  z  solves  (6),  then  any  solution  along  the  trajectory 

{b*  +  Kt_1zt"1]t^1  solves  (2). 
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Proof: 


t  T 

Suppose  {x  }t_j  solves  (2). 

12  T  -1 

Consider  x  =  (x  ,x  , ,x  )  as  a  solution  of  (6).  It  is  easy  to  see 
that  h*(x)  5  c*x*,  since  x*  is  a  feasible  solution  of  (4).  Suppose  there 

t  T  T  t  t  T  t  T,  t 

is  some  other  z,  and  {y  }  ,  such  that  c  y  =  \  h  (z)  <  \  h  (x)  = 

T  t=l  t=l  t=l 

^  c  x  .  Then  (y  is  feasible  for  (2),  contradicting  the  optimality 
t=l 

of  {x*}^  • 

t  X 

Now  assume  z  solves  (6)  and  fx1}^  is  optimal  along  that  tra- 

t  X  t  X 

jectory.  If  (x  does  not  solve  (2)  there  exists  a  f y  3 ^ ®uch  that 


T 

\r 


cV  <  f"  c‘x*  . 


12  T  -1 

y  =  (y  ,y  , . .  ,y  )  determines  a  trajectory  along 


t=l 


which  it  is  feasible,  and  h*(y)  5  c*y*  for  each  t  .  Thus 


I  T  T  T 

Z  h‘(y)  -  Z  c'yt  <  Z  c*xt  =  Z  h‘,z) 

t=l  t=l  t=l  t=l 

contradicting  the  optimality  of  z  .  || 

Note  the  theorem  implies  the  existence  of  an  optimal  solution 
that  is  an  extreme  point  optimal  solution  of  each  subproblem. 

Before  stating  the  restricted  problem,  we  will  inspect  the  sub¬ 
problems,  (5),  in  greater  detail.  Assume  we  have  found  a  trajectory 
z  such  that  each  subproblem  (5)  has  a  finite  optimal  solution.  Let 
(U*,  V*)  be  the  matrix  of  extreme  optimal  solutions.  If  (u*,  v*)  is  a 
row  of  (U*,  V*)  then  it  is  an  extreme  point  of  (5)  and 
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t.,t  T.t-1  t-1.  ,  t^t  t  ,  t.  . 
u(b  -t  K  z  )+vKz  =h(z) 


Similarly  let  (R*,^*)  be  the  matrix  of  extreme  tight  rays.  If  (r*,q*)  is 

a  row  of  (R^^)  then  (r*,q*)  is  an  extreme  ray  and 

t.,t  ..t-1  t-1.  ,  Lt  t  n 
r(b+K  z  )+qKz=0 

12  T-1 

If  we  are  going  to  change  z  =  (z  ,  z  , . .  ,  z  )  in  the  direction 
y  =  (y\y2,.  •  .yT_1).  we  must  have 

TSV’V’1  +  QtKtyt  ^  0 


or  the  subproblems,  (5),  will  become  unbounded.  We  can  also  show 
using  Theorem  11:7,  that 

Vh^zjy)  =  Max  (U^'V"1  +  vHtV] 

Finally,  we  must  have  y*  =  0,  if  z*  =  0. 

Using  all  this  information,  we  can  write  the  restricted  problem  as: 
T 


Minimize 


2-* 

t=i 


(6) 


Subject  to  P^(e^)  -  V^K^y* 


pV) 


-  QVy1 

.  uV-y-1 


5  o 
5  0 


V* K V  5  0 


-  rV’V*1  -  Q^y4  S  o  for  t  =  2,3 . T 


pT(eT)  -  VTKT‘V-1 
-  RTKT"lyT“1 


5  0 
5  0 


(-1.-1. 


5  0  if  z:  =  0  , 
i 


-1)  ^  y*?  (1,1 . 1) 


t  =  1,2...  ,T  - 
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The  restricted  problem  has  the  same  linked  structure  as  the 

original  problem.  Note  that  some  of  the  lower  bounds  on  the  y*  are 

redundant.  The  method  suggested  for  solving  (6)  is  almost  identical 

with  the  resource  directive  case. 

After  (5)  has  been  solved,  for  some  z,  a  matrix  representation 

of  the  optimal  solutions  is  available.  This  is  denoted  W*  .  From  this 

set  of  linear  inequalities,  we  can  immediately  discover  a  few  optimal 

extreme  solutions  and  tight  extreme  rays.  These  are  the  solutions  at 

hand.  With  this  and  past  information  we  solve  a  partial  or  cut  down 

version  of  (6),  using  the  dual  simplex  method  with  upperbounds.  This 

12  T  — 1  t  T 

generates  a  solution  y  =  (y  ,y  ,y  j,  {p  .  This  solution  is 
optimal  for  (6)  it  it  is  feasible.  Feasibility  is  checked  by  solving  the 
tight  problems 

,  Max  uV'V"1)  +  v4(kV)  (7) 

Subject  to  (u*,  v*)  e  W* 


The  solution  is  feasible  if,  for  each  t,  the  optimal  value  of  the  tight 
program  is  no  greater  than  p* .  Otherwise  the  tight  programs  gener¬ 
ate  an  infeasible  constraint  of  (6). 

Suppose  y  is  optimal  for  (6).  Now  we  will  change  z  in  the  direc¬ 
tion  y.  The  new  z  must  be  non  negative,  so  we  can  proceed  no  further 
than. 


3  =  Min 


-t 

’Yt 


-t 

yi< 


0,  t  =  1,2,..  ,T 


-  1 


In  addition,  for  each  subproblem,  (5),  we  consider  the  parametric 
objective 
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t,  t  t„t-l  t-1  ,  „  t„t-l-t-l 
ub+uK  z  +auK  y 


Lt  t  t„t-t 
+  vKz  +  a  v  K  y 


The  parameter  a  is  increased  until  some  new  reduced  cost  coefficent 
is  zero,  indicating  an  unbounded  solution  or  a  new  extreme  optimal 
solution.  Call  that  value  a*  and  let 

a*  ~  Min  [a4  |  t  =  1, 2, . .  ,  t] 


0  =  Min  [a  ,  P  ]  >  0 


(8) 


If  6  is  infinite  then  there  is  an  unbounded  solution.  Otherwise  the 
new  solution  is 

£  =  z*  +  Gy1  t  =  1,2,..  ,T  -  1 


As  before  the  constraints  in  that  are  slack  after  (6)  has  been 

solved  can  be  eliminated,  while  the  tight  constraints  should  be  retained. 

For  each  t  such  that  a*  =  9,  there  is  a,  new  constraint  generated  for  (6) 

r.t  i 

Also, for  each  (t,  i)  such  that  6  = 
to  (6). 


z. 

i 


-y* 


,  the  constraint  y.  =  0  is  added 

7i 


MULTI-STAGE  PROGRAMS -TRAJECTORY  OPTIMIZATION 

Step  0:  Find  an  initial  trajectory  such  that  each  subproblem,  (5), 

has  a  bounded  optimal  solution.  If  no  such  trajectory  exists, 
then  (2)  is  infeasible.  If  any  of  the  subproblems  are  infeasible, 
then  (3)  is  infeasible.  Send  the  optimal  solutions  and  extreme 
rays  at  hand  to  the  restricted  problem. 


-37- 


Step  1: 


Step  2; 


Solve  the  partial  version  of  the  restricted  problem  by  the 
dual  simplex  method  with  upper  bounded  variables,  and 
generate  new  rows  by  solving  the  tight  problems, (7).  If 
the  optimal  value  of  (6)  is  zero,  the  current  trajectory  is 
optimal. 

Determine  how  far  to  proceed  in  the  new  direction,  (8).  If 
0  is  infinite,  the  problem  is  unbounded:  otherwise  generate 
the  new  restricted  problem  and  go  to  1. 
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APPENDIX 

For  the  general  multi-stage  problem,  (V;I)  the  subproblems  are 
for  t  =  1,  2.  . .  ,  T 


Min  c*x* 

(1) 

Subject  to  A*x* 

=  d*  +  'i*  h*v 

8  =1 

H8txfc  =  HSV  s  =  t  +  1,  t+2 . T 


Actually  the  dual  of  (1)  will  be  solved 

t-1  X 

Max  u*(d*  +  ^  HtSz8)  +  ^  v8tH8tz*  (2) 

s  =1  8  =t+l 

T 

c  ,  .  tAt  st-,st  <  t 

Subject  to  u  A  +  >  v  H  -  c 

s=t+l 

Although  (2)  has  a  large  number  of  variables,  it  has  the  same 
number  of  constraints  as  the  subproblems  considered  in  the  special 
case  (V:5). 

The  construction  of  the  restricted  problem  is  straight  forward. 

It  will  inherit  the  lower  block  triangular  structure  of  the  original  prob¬ 
lem  (V:l). 
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